DOCUMENT RESUME 



ED 233 082 



TM 830 542 



TITLE 

INSTITUTION 

REPORT NO 
PUB DATE 
NOTE 
PUB TYPE 



Basic Skills Achievement, 1981-82. 
Austin Independent School District, 
Research and Evaluation. 
AISD-ORE-8130 
[82] 

36p.; for related documents, see 
Reports Evaluative/Feasibility 
Data (110) 



Tex. Office of 



ED 228 249-250. 
(142) — Statistical 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



MF01/PC02 Plus Postage. 

^Academic Achievement; *Basic Skills; Elementary 
Secondary Education; Local Norms; National Norms; 
Scores; ^Standardized Tests; ^Testing Programs; *Test 
Norms 

*Austin Independent School District TX; Iowa Tests of 
Basic Skills; Metropolitan Readiness Test; Sequential 
Tests of Educational Progress 



ABSTRACT 

The Austin Independent School District (AISD) office 
of Research and Evaluation presents Basic Skills Achievement, 1981-82 
(BSA). The BSA answers the following questions: (1) How does AISD 
student achievement compare to student achievement nationwide? (2) 
How does AISD's 1981-82 student achievement compare to the 
achievement of students in past years? (3) How large were the 
achievement gains made by AISD students in 1981-82? (4) What was the 
impact of the change in the, policy for inclusion of special education 
students in standardized testing? (5) How did AISD entering 
first-grade students perform on the Metropolitan Readiness Tests? (6) 
How do AISD students compare with others taking college admission 
tests? (7) What do AISD teachers and administrators say about basic 
skills achievement? (8) How do 1981-82 AISD demographic data compare 
to past years? (9) What other information should be considered to 
determine if basic skills have improved in AISD? (PN) 
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FINAL REPORT 



Project Title: Basic Skills Achievement 



Contact Person: Kevin Matter, Glynn Ligon 



Major Positive Findings ; 

1. Students in AISD achieve above the national average in every area 
and in every grade with only these exceptions: twelfth-grade 
reading and kindergarten language scores are at the national average; 
and kindergarten listening and math scores are just below the national 
average* 

2. Achievement in grades 1-8 is clearly up across the last three years. 

3. Between grades 3 and 8, the yearly achievement gains for AISD stu- 
dents are higher than normally expected* 

4. Kindergarten atudents made a 9.5 month achievement gain in 7 months 
on the ITBS Language Test. 

5. From 1980 to 1982, uhe general trend has been upward on the TABS 
(grades 3, 5, and 9). The greatest improvement has been at grade 3. 



Major Findings Requiring Action ; 

1. High school students reinain above the national average from grades 
9-12, but they demonstrate small declines in their percentile ranks, 
This is most clear in reading skills. 

2-. The group of students entering grade 5 in 1982-83 has been, a re- 
latively low-achieving group across grades 2-4. Their progress 
warrants attention as they continue into grade 5. 
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HOW DOES AISD STUDENT ACHIEVEMENT COMPARE TO STUDENT ACHIEVE- 
MENT NATIONWIDE? 



• Students in AISD achieve above the national average in 
every area and in every grade with only these exceptions: 

- Kindergarteners are at the national average 
in langtiage and just below in listening and 
math skills. 

- Twelfth graders are at the national average 
in reading skills* 

• AISD students' highest achievement is in: 

- Language skills in grades 

- Math computation in grades 9-12. 

• AISD students' lowest achievement is in: 

- Math in grades 1-8* 

- Reading in grades 9-12* 

• The average student in AISD outperforms three fourths of 
the students in other urban school districts. 

Achievement in grades 1-12 is above the national average (1978 norms) 
in every area, except for reading at grade 12 which is at the 50th %ile 
(Figure 1) • 

• The area of highest achievement in grades 1-8 most often 

is language, with AISD averages from 2-22 percentile points 
above the national average (Figure 2). 

. Lowest achievement for students in grades 1-8 is usually 
in math, although math is still above the national aver- 
age by 1-9 percentile points. 

. Achievement in grades 1-8 is substantially above average 
compared to students in other urban settings (Figure 3). 
AISD medians range from the 72nd to the 86th percentile. 

AISD high school students can be compared to two nationwide reference 
groups from 1970 and 1978. The national sample who took the test in 
1970 used the form given in AISD. The 1978 sample took a 1978 revision 
of the STEP, and then the two test editions were equated. (See Figure 4.) 

. Compared to students nationwide in 1978, AISD students 
in grades 9-12 are achieving highest in Math Computation, 
scoring 11-21 percentile points higher than the norm group. 
Reading is the lowest achievement area in grades 9-12. 

• Compared to students tested nationwide in 1970, achievement 
in grades 9-12 is highest in Math Basic Concepts and lowest 
in Mechanics of Writing. 
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This year all kindergarten students were also tested in April. 

. Students in AISD kindergarten classes achieved at the 
national average in language (50th Zile) and at the 
48th %ile in both listening and math (Figure 5). 

(Text aonZuiiiti on page II-SJ 
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figure !• AISD MEDIAN PERCENTILES, 1981-82, 1978 NORMS, GRADES iC-12, 

NOTE: Grad€J iC-6 «xclud« scores for special educacioa students receiving 
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Figure 2. ITBS PERCENTILE AND GRADE EQUIVALENT MEDIANS, BY ETHNICITY, 1979-80 THROUGH 
1981-82. Students at grade level would receive an X.8 grade equivalent 
median In grades 1-6 and an X.67 median In grades 7 and 8. The median 
percentile rank for the national norm group Is 50 for all grades. 

(Page 1 of 2, Reading Total and Math Total.) 
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*Far trade* 1 Mii 2, SpuUing In die only Uiiguag. Cu^C. 

Figure 2. ITBS PERCENTILE AND GRADE EQUIVALENT 
MEDIANS, 1979-80 THROUGH 1981-82. 

(Page 2 of 2, Language Tot£»,3 , Word 
Analysis, and Work-Stu <} Total.) 
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Figure 4. STEP MEDIAN PERCENTILES » 1977-78 THR0UC21 1981-82, GRADES 9-12, 
1970 AND 1978 MORMS. 
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HOW DOES AISD'S 1981-82 STUDENT ACHIEVEMENT COHPARS TO THE 
ACHIEVEMENT OF STUDENTS IN PAST YEARS? 



• Achievement in grades 1-8 is clearly uv across Che last 
three years. 

• Achievement in grades 9-12 has changed little across the 
last five years, but the small changes that have occurred 
have been mostly downward* 



1981-82 Compared to 1980-81 > Achievement in grades 1-8 improved by a 
small amount in 1981-82 over the levels of 1980-81. 

. Reading and math changed very little. What changes did 
occur were in a positive direction. 

, Language scores were clearly higher in 1981—82. 

. Work-study skills scores were somewhat higher. 

Achievement in grades 9-12 changed very little last year. 

. Reading scores improved one to four percentile points 
in grades 9-11, but dropped two percentile points in 
grade 12. 

• Math results were mixed. Math Basic Concepts scores 
remained the same in grades 10 and 12 and moved slightly 
upward in grade 9 (+1 percentile)' and grade 11 (+3 per- 
centiles). Math Computation scores drifted one percen- 
tile lower at each grade. 

Retainees. More students were retained at the end of the 1980-81 school 
year than in previous years. Most retainees were in grades 1, 7, and 9. 
The impact of this increase in retainees was to lower slightly the median 
scores in these grades compared to the previous year. There was then a 
small positive effect upon the medians at the other grade levels. 

Longitudinal Comparisons . Elementary and junior high achievement scores 
have improved noticeably over the past three years in which the IT3S has 
been administered. 

Language scores have shown the most dramatic rise to 
levels well above the national average. 

, Reading, math, and work-study skills scores are also 
clearly up over the three-year period. 

. Students who were in grade 3 in 1980-81 and in grade 4 
in 1981-82 appear to be a noticeably lower achieving 
group than are students at other grades. 
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Higli school achievement has been very stable across the last five years; 
however i> most of the changes which have been noted are in a downward 
direction- This trend may change as the higher achieving students now 
in jtinior high move through the high school grades- 

Reading, achievement has declined one to five percentile 
points across the last five years- 

- Math achievement is virtually the same across the last 
five years, but the small changes occurring have mostly 
been increases of one percentile point- 

• Mechanics of Writing test scores are practically the 
same across the past five years in grades 9-11- Grade 12 
scores are lower across the last two years, but still 
higher across the last five years- 

• Science scores have fallen in all grades during the past 
five years - 

Figures 2 and 4 provide the AISD median scores for past years which 
were referenced in these summary statements - 



HOW LARGE WERE THE ACHIEVEMENT GAINS MADE BY AISD STUDENTS 
IN 1981-82? 



• Reading: 

• The achievement gains of AISD students are greater 
than normally expected between grades 3 and 8- 

• Achievement gaina are less than normally expected 
between grades 1 and 3, and between grades 9-12- 

• Math: 

• The achievement gains of AISD students are greater 
than normally expected between grades 2 and 8- 

• Achievement gains are less than normally expected 
between grades 1 and 2, and between grades 9 and 12, 

• Kindergarten students demonstrated. 9-5 months' growth in 
language skills in the 7 months between fall and spring 
testing- 



Although AISD students achieve above the national average at all grades, 
their yearly achievement gains vary by grade level- The gains which, are 
"normally expected" are defined as achievement progress on standardized 
tests great enough to maintain the same percentile rank from one year to 
the next- Students who had been enrolled in AISD for three consecutive 
years and who had not been retained or double promoted during that time 
were used to measure these gains - 
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Figure 6 presents a sample of the results The reading and math gains for 
three groups of students are graphed. There is some variance in the patterns 
of achievement across these three years for students in different grades; 
however, the general trend is for there to be gains' in the grades from 3 to 
8 and losses in the earlier and later grades. Ttie actual median scores for 
these continuously enrolled students are presented in Section III, System- 
wide Aciiievement Profiles. 

Figure 7 displays graphically the gains made by kindergarten students. 
A,fter entering in September below the national average, they were above 
the national average on the ITBS Language Test in April. 

H 



90. 



80. 




Figure 6. LONGITUDINAl. COMPARISON OF MEDUN PERCEtmLSS FOR THREE 

GROUPS OF STUDENTS WHO ^^RE CONTINUOUSLY ENROtXED IN AISD 
FROM 1979-80 THROUGH 1981-82. Percanciles based on 1978 
norm groups. Scores are for ITBS Reading Total in grades 
2-8 and ^or STEP Reading in grades 10-12. Math scores are 
for ITBS Hath Total in grades 2-8 and for STEP Math Compu- 
tation in grades 10-12. 
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WHAT WAS THE IMPACT OF THE CHANGE IN THE POLICY FOR INCLUSION 
OF SPECIAL EDUCATION STUDENTS IN STANDARDIZED TESTING? 



• More special education students were tested in 1981-82 
than in the previous year. 

• There was little change in which, special education students 
were exempted from testing as a result of the new policy. 

Each special education student's Admission, Review, and Dismissal (ARD) 
Committee now determines the participation of that student in standardized 
testing. When the new policy for inclusion of special education students 
in standardized testing was adopted, there was one major concern and one 
major hope for the impact. Concern was expressed that the ARD Committees 
would label too many students to be tested for experience only so that 
their scores would not be included in school averages. Hope was expres- 
sed that many more special education students who had previously been 
exempted from- testing would be tested for the experience. The concern 
was not realized—fewer than 100 students who would have been tested for 
a valid score under the previous policy were tested for experience only 
upon the recommendation of their ARD Committees. The hope was realized— 
over 500 more special education students were tested under the new policy. 
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HOW DID AISD ENTERING FIRST-GRADE STUDENTS PERFORM ON. THE 
METROPOLITAN READINESS TESTS? 



The Metropolitan Readiness Tests (MET) scores of AISD entering first-grade 
students in 1981-82 were the highest ever recorded and, for the first time, 
exceeded those of the national norm group in all areas. The median Prc- 
Reading Composite score increased by four percentile points compared to 
last year and exceeded the national norm for the third consecutive year. 



HOW DO AISD STUDENTS COMPARE WITH OTHERS TAKING COLLEGE ADMIS- 
SION TEST§? 



Scholastic Aptitude Test CSAT) 

. Average scores of AISD students who took the SAT in 1980-81 were 
higher than the national average on all tests, including both apti- 
tude and achievement. AISD students have scored above the national 
average on the verbal and math tests for ten consecutive years. 

• The average AISD SAT-Math score declined by four points from 1979-80 
to 1980-81, while the average AISD SAT-Verbal score remained the same 
as in 1979-80. 

. The general trend in SAT scores over the past ten years has been 
downward. However, SAT scores of AISD students have declined less 
rapidly than the national average. 

. The group of AISD students who took the SAT in 1980-81 was higher by 
two percentage points in minority participation than the nationwide 
group.. AISD students, however, reported higher overall grade point 
averages and higher parental income than the national sample. 

American College Test CACT) 

. Fewer AISD students chose to take the ACT in 1980-81 than in 1979-80, 
continuing a ten-year trend of declining participation in the ACT. 

. AISD mean scores for all subtests of the. ACT were lower in 1980-81 
than the means for the national sample. Scores for both AISD and 
the national sample have declined since 1972-73, with AISD scores 
declining more sharply. 
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WHAT DO AISD TEACHERS AND ADMINISTRATORS SAY ABOUT BASIC 
SKILLS ACHIEVEMENT? 



One half of the teachers and administrators were surveyed In the spring 
of 1982, 

63% agreed that the^District emphasis on basic skills has been 
effective in improving the basic skills of AISD students. 

52% agreed that the emphasis on attendance has helped to improve 
students^ basic skills. 28% did not agree. 

39% of the teachers and 50% of the administrators agreed that the 
T^rt.nimTim competency requirements for graduation have been effective 
in improving students^ basic skills. 14% did not agree. 



HOW DO 1981-82 AISD DEMOGRAPHIC DATA COMPARE TO PAST YEARS? 



Membership 

The average number of students enrolled in AISD declined in 1981-82, 
following a general pattern over the past six years. However, the rate 
of decline in 1981-82 was 1%, slower than the 5% rate of decline in 

1980- 81 and the 2% rate in 1979-80. 

Attendance 

. The overall 1981-82 District attendance rate (93.2%) was the highest 
in eleven years. 

. Junior and senior high attendance both increased, reaching 93.2% and 
91.5% respectively. 

Elementary attendance held even at 94.2%. 
School Leavers 

^ School leavers are students who withdraw from AISD during the school year 
and are not known to go to other schools. Th.e school-leaver rate in 1981- 
1982 fell to 2.7%, the lowest in three years. 

Graduation Rates 

The percentage of ninth- through, twelfth-grade students who graduated in 

1981- 82 was 19.8%, up slightly from 19.6% last year and the highest in 
the eleven years that graduation rates have been calculated. 
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WHAT OTHER INFORMATION SHOULD BE CONSIDERED TO DETERMINE IF 
BASIC SKILLS HAVE IMPROVED IN AISD? 



In addition to looking at District achievement in the basic skills areas, 
it is important ,to examine the success of special programs which share 
the goal of improving basic skills achievement. The reader is urged to 
refer to the 1981-82 findings of the following special programs. 

Section in 1981-82 
Program Evaluation Findings 

High School Graduation Minimum 

Competency Requirements V 

ESEA Title I XIV 

ESEA Title I Migrant XV 

Local/State Bilingual XVI 

State Compensatory Education XVIII 

A study of the overlapping of services to the same students by multiple 
special programs showed that overlaps decreased in 1980-81, when the 
number of students served by more than two such programs dropped 
by about. 75%. In 1981-82, the number of students served by more than 
two special programs continued to be much lower than before 1980-81, 

Analysis of AISD students^ peformance on the Texas Assessment of Basic 
Skills (TABS) shows the following. 

. From 1980 to 1982, the general trend in scores has 
been upward, with 'the most improvement at grade three. 

• Although White students still outperform Hispanic and 
Black students, overall gains for minorities over the 
past two years were greater than the gains for White 
student^. 

AISD's minimum competency requirements for graduation 
are higher than the state-adopted minimum competency 
level for the TABS. 
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Miscellaneous ABSTRACT 



Title : How To Read an ITBS Student Skills Analysis 



Contact Person; Patsy Totusek 



No* Pages; 13 



Summary ; 

•This is a handout developed to provide information to anyone wanting 
to find out how to make the most use of the ITBS Student Skills Analysis. 
It was distributed mainly to teachers and principals. 

The handout consists of two sections; 

. How to Read an ITBS Student Skills Analysis 

. Using The Individual Student Skills Analysis to Better Instruction 
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Evaluation Design 



ABSTRACT 



Title: EVALUATION DESIGN: Basic Skills > 1981-82 



Contact Person ; Kevin Matter, Glynn Llgon 



No, Pages ; 14 



Summary ; 



The evalxiatlon design is a one-year plan of evaluation work for this 
project. It provides a brief project* and evaluation summary, and 
identifies the decision and evaluation questions to be addressed, other 
information needs, dissemination plans, resources required, and infor- 
mation sources to be used. 

In May, 1976, the Board adopted a formal set of priorities for the 
District for the 1976-77 school year. One of these stressed improving 
student performance in reading and mathematics. This emphasis on 
basic skills has continued up to the present. The District's Five-Year 
Plan for Accreditation, which went into effect for the 1980-81 school 
y\»ar, calls for improvement in the same basic skills areas. 

The Basic Skills evaluation will focus on two primary areas during the 
1981-82 school year; 

student performance in basic skills as measured by 
standardized achievement tests. 

. student attendance, school-leaver, and graduation rates. 

For the most part, the evaluation efforts will be concentrating on data 
that already exist or are routinely collected during the year. This 
includes achievement test results; results for AISD students who take 
the SAT and/or the ACT; attendance, school-leaver, and graduation records. 
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Technical Report 



ABSTRACT 



Title: FINAL TECHNICAL REPORT: Systemwide Evaluation 1981-82 



Contact Person: Glynn Llgon, Kevin Matter, Nancy Baenen 



Nc> Pages : 500 



Summary : 

The Final Technical Report is a detailed account of the instruments used 
in data collection, and the purposes, procedures, and results of the data 
collection effort • The information presented in this volume relates to 
the District's Five-*Year Plan for Accreditation, which emphasizes improving 
student achievement in basic skills, with a special focus on lev -SES and 
minority student achievement* 

The technical report is organized arotmd data collection sources and 
includes the following appendices: 

Scholastic Aptitude Test (SAT) 
American Collegs Test (ACT) 
Preliminary Scholastic Aptitude Test CPSAT) 
Sequential Tests of Educational Progress CSTEP) 
Iowa Tests of Basic Skills (ITBS) 
Metropolitan Readiness Tests (MRT) 
Texas Assessment of Basic Skills CTABS) 
Teacher Survey 
Administrator Survey 
Accreditation Status Report 
District Attendance Records 
District Graduation Records 
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Brochure ABSTRACT 

Title : Talking to Parents About Test Scores (Junior High) 
Contact Person : Kevin Matter, Glynn Ligon 
No, Pages ; 8 
Summary ; 

This brochure provides answers to some basic questions which a) teachers 
might ask when preparing to report test scores to parents and b) parents 
might ask about their child's score on a standardized test. AISD junior 
high 1981 median ITBS math and reading scores are provided for comparison 
of individual students' scores to the District average. 

Comments : 

. This is a revised edition of publication 80.41. The revisions made 
reflect the changes* in scores en the Iowa Tests of Basic Skills. 

. See publication 31.27 for a similar brochure for elementary students. 
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Brochure ABSTRACT 



Title: Talking to Parents About Test Scores (Elementary) 



Contact Person: Kevin Matter, Glynn Ligon 



No. Pages: 8 



Stnrmiary 

This brochure provides answers to some basic questions which a) teachers 
might ask. when preparing to report test scores to parents and b) parents 
might ask about their child's score on a standardized test. Median AISD 
elementary ITBS scores in math, and reading for 1981 are provided for 
comparison of individual students' scores to the District average. 



Comments : 

See publication 81.25 for a similar brochure for junior high school students. 



19 



23 



81 ,30 

(81.28) 



Brochure ABSTRACT 



Title: Achievement Testing in Austin Schools, 1981-82 



Contact Person; Kevin Matter, Glynn Ligon 



No. Pages: 4 



This brochure describes the achievement tests and the language fluency 
tests used in the Austin Independent School District to measure the 
development of basic skills in math and reading and fluency in the En- 
glish, language. Included in the brochure are descriptions of: 

. the Iowa Tests of Basic Skills, Level 5 Language Test, 

which is given to all kindergarten students in the fall; 
. the Metropolitan Readiness Tests which is giv n to all 

first graders in the fall; 
. the Iowa Tests of Basic Skills which is given to all 

kindergarten through eighth-grade students ; 
. the Sequential Tests of Educational Progress which is 

given to all ninth- through twelfth-grade students; 
. the Primary Acquisition of Language (PAL) test which, is 

used to measure students' fluency in oral English in 

kindergarten through sixth grade; 
. the Language Assessment Battery CLAB) which is used in 

grades seven through twelve to measure language dominance; 
. the California Achievement Tests and the Comprehensive 

Tests of Basic Skills, which are xised to further assess 

reading and language skills of certain students in grades 

2-12 who have taken the PAL or LAB; and 
. the relationship between Austin Independent School 

District's achievement testing program and the high. 

school minimum competency graduation requirement. 



Comment ; 

This is a revised edition of publication 80.60. 
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Newsletter ABSTRACT 



Title; Nuts and Bolts of Testing 1981-82. Bulletins for Building Test 
Coordinators and Principals, 



Contact Person ; Kevin Matter, Glynn Ligon 

No. Pages : 19 

Summary ; 

This is a periodic newsletter for building test coordinators. There are 
separate sets of issues for test coordinators in elementary schools, 
junior high schools, and senior high schools. The issues summarize 
topics discussed at meetings, answer questions from btjilding test coordi- 
nators, announce future meetings, and provide current updates on issues 
related to testing,, etc. 

The number of issues for each level in 1981-82 was; 

K-12 - 1 

Elementary - 7 
Junior High - 3 
7-12 - 1 

Senior High - 3 
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Brochure ABSTRACT 



Title : Your Child's Scores In Basic Skills - Iowa Tests of Basic Skills, 
AISD Elementary Schools, School Year 1981-82 



Contact Person: Kevin Matter, Glynn Ligon 



No> Pages : 6 



Suimnary : 

This brochure is sent to the parents of all students in grades one through 
six who took the Iowa Tests of Basic Skills (IT33). Each student's ITBS 
scores are provided on a gummed label to be affixed to the last page of 
the brochure. Using a quest ion-and-answer format, the brochure provides 
information about the test and the test scores. A Spanish version is also 
available. 



Comments : 

This is a revised edition of last year's publication 80.76. 
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Brochure ABSTRACT 



Title: Tour Scores in Basic Skills - Iowa Tests of Basic Skills, AISD 
Junior High Schools, School Year 1981-82 



Contact Person; Kevin Matter, Glynn Ligon 



No. Pages ; 6 



Summary ; 

A copy of this brochure is provided to each junior high school student who 
took the Iowa Tests of Basic Skills (ITBS), Each student's ITBS scores 
are provided on a gummed label to be affixed to the last page of the bro- 
chure. Using a question-and-answer format, the brochure provides infor- 
mation about the test, the test scores, and high school graduation minimum 
competency requirements. 



Comments ; 

This is a revised and updated edition of last year's publication 80,75 • 
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Brochure ABSTRACT 



Title : Your Scores in Basic Skills - Sequential Tests of Educational 
Progress, AISD High Schools, School Year 1981-82 

Contact Person; Kevin Matter, Glynn Ligon 



No> Pages : 6 
Summary : 

A copy of this brochure is provided to each high school student who took 
the Sequential Tests of Educational Progress (STEP). Each student's STEP 
scores are provided on a gummed label to be affixed to the last page of 
the brochure* Using a question-and-answer format, the brochure provides 
information about the tests, the test scores, and competency requirements 
for graduation • 



Comments : 

This is a revised and updated edition of last year's publication 80 •74. 
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Occasional Paper ABSTHACT 

Title : 1. Develop Your Own Practice Test When ... a) You Change 

Achievement Tests; b) Your Needs are Unique; c) You Don^t Have 
Hach Money; d) All of the Above. 



Contact Persons: Catherine Christner, Kevin Matter, Glynn Ligon 



No. Pages; 15 



Summary : 

Practice tests were developed in an urban school district as a result of 
changing the standardized achievement tests given in grades one through 
eight. The Iowa Tests of Basic Skills, normed in 1978, were chosen to 
replace the California Achievement Tests, normed in 1970. This paper 
details the reasons for the development of the practice tests, as well 
as the actual development process. Finally the success of the practice 
tests is judged in terms of district personnel's responses to its actual 
use. 

Comments : 

This paper was presented at the 1982 annual meeting of the American Educa- 
tional Research Association in New York. 
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Occasional Paper ABSTRACT 



Title: Warning! Iceberg!: A Checklist of Issues Related to Changing 
Achievement Testa 



Contact Person: Glynn Ligon 



No> Pages : 8 



Summary : 

When your test booklets are all dog-eared and coming unstapled, when you 
have marked all five answers to some items in the booklets because stu- 
dents have marked the "correct" choice, when your college-bound seniors 
are scoring at the 25th percentile because you are still using 1965 norms, 
when half the teachers have copies of the test in their desks, and when 
older students support their habits by selling test items to freshmen, 
then you finally get up the nerve^ to face changing achievement tests. 
Every ounce of energy is focxised on two tasks— selecting a replacement 
and obtaining the money to purchase it, ' Whan this happened in the Austin 
Independent School District, we discovered that these two tasks were just 
the tip of an iceberg. Literally hundreds of smaller tasks, issues, and 
decisions loomed below. 

The selection of a new achievement test and the securing of the funds to 
purchase it are indeed the overriding concerns of systems changing tests. 
During the transition, hundreds of smaller decisions must be made — many 
of these involving changes necessitated by the new test but unanticipated 
beforehand. To ensure a successful transition, these decisions must be 
anticipated to allow planning to take place. The experiences of Austin's 
school system can be of great assistance to others,, not so much, in pro- 
viding answers, as in identifying the issues which must be addressed. 



Comments ; 

This paper was presented at the American Educational Research. Association 
meeting in New York, New York in March, 1982, 
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Occasional Paper ABSTRACT 



Title: Anomalies in Achievement Analyses 



Contact Person: Glynn Ligon, Kevin Matter 



No. Pages : 14 
Summary : 

The explanation of standardized achievement test results is not a simple 
process, particularly when unexpected anomalies or mystifying inconsis- 
tencies are present in the data* This paper pulls together these anomalies, 
along with some questions which often confuse teachers, and other school 
staff. A practitioner's perspective is taken to assist researchers and 
evaluators in understanding when an inconsistency is an error and when 
it is an explainable anomaly. 



CoTTiments : 

This paper was presented at the American Education Research Association 
meeting in New York, New York in March, 1982. 
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Occasional Paper ABSTRACT 



Title; Preparing Students for Standardized Testing: A Literature Review 



Contact Person: Phil Jones, Glynn Ligon 



No. Pages : 8 



Summary : 

This literature review focuses on three variables which affect students' 
achievement scores and which can be manipulated prior to test administra- 
tion. They are (1) testwiseness , C2) practice tests, and C3) test practice. 

Testwiseness is a student's ability to enhance his or"her score by using 
strategies independent of content knowledge. Testwiseness can be measured 
and taught, is only mildly related to general intelligence, increases 
with maturation, and is unrelated to sex. Although testwiseness skills 
can be taught (and the reliability and predictive power of some tests may 
be thus enhanced) , the effects of such instruction do not last long and 
may vary with the type of skill being taught. Some of the implications 
of these research findings bearing on public school administration are 
explored in this paper. 

Taking one standardized test for practice was found to Improve scores 
on a subsequent test up to two months later. Any further test practice 
was found to produ('3 no further improvement* 

No research was found describing the effects of practice tests on student 
performance or on the reliability or predictive power of the associated 
test. 

Comments : 

This paper was presented at va American Educational Research Association 
meeting in New York, New Yod in March, 1982. 
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Occasional Paper ABSTRACT 



Title ; Preparing Students for Standardized Testing; One Distrlctis 
Perspective 



Contact Person: Glynn Llgon, Phil Jones 



No , Pages ; 8 



Summary ; 

In our school system with 80 schools, we foxind 80 approaches to preparing 
students for their annual standardized achievement test. So that compari- 
sons of achievement test scores across campuses would.be unaffected by 
variations in these test preparation activities, we set out to standardize 
all testwlseness instruction and practice testing across the school system. 

An appropriate preparation activity was defined as one which meets two 
criteria. It must ; 

(1) contribute to students* performing on the test near 
their true achievement levels, and 

(2) contribute more to their scores than would an equal 
amount of regular classroom Instruction. 

This paper identifies appropriate testwlseness skills to teach. The bases 
for these distinctions were two; 

(1) a review of the research literature on testwlseness (see 
ORE publication no. 81.61), and 

(2) an informal study of the testwlseness cues helpful in 
taking the Iowa Tests of Basic Skills* 

Test practice is advocated; however, the use of full-length standardized 
tests for practice seems a poor use of valuable instructional time. In- 
stead, teachers are encouraged to make their own tests more like standardized 
tests 

Preparing students for standardized tests is important. Students need 
and deserve to know what the tests are, why they are taking them, and 
why they are important. The classroom teacher is the key person in 
standardizing preparation procedures. Locally developed materials for 
teachers to use to this end are described and made available. 



Comments ; 

This paper was presented at the American Educational Research Association 
meeting in New York, New York in March, 1982, 
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Miscellaneous Document ABSTRACT 

Title: Packet for the Preparation of Students for the ITBS; Kindergarten 
Contact Person : Kevin Matter, Glynn Ligon 
No. Pages : 5 



Summary ; 

This packet is intended to help standardize the way that kindergarten 
students are prepared to take the Iowa Tests of Basic Skills. It 
consists of the objectives for three presentations. 

The documents, in the order they are* to be presented are: 

1. Introduction to Standardized Testing 

2» Testwiseness 

3. Being Prepared for Testing 

These documents have scripts which teachers may tise as a guide for 
presenting the objectives. 



Comments ; 

. See publication 80.63 and 80.70 for similar documents for first through 
eighth graders. 

. See ptjfalication 79.26 for more complete information on AISD Practice 
Tests. 
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Brochure ABSTRACT 



Title ; Your Child's Scores in Basic Skills - Iowa Tests of Basic Skills, 
AISD Kindergarten, School Year 1981-82 



Contact Person ; Kevin Matter, Glynn Ligon 



No. Pages ; 4 



"^ umniary ; 

This brochure is sent to the parents of all kindergarten students who 
took the Iowa Tests of Basic Skills (ITBS) in the spring. Each student's 
ITBS scores are printed on the last page of the brochure. Using a 
question-and-answer format, the brochure provides infarmation about the 
test and the test scores, A Spanish version is available also. 
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